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Instructions for Completing Consolidated State Application 

Accountability Workbook 

By January 31 , 2003, States must complete and submit to the Department this 
Consolidated State Application Accountability Workbook. We understand that some of 
the critical elements for the key principles may still be under consideration and may not 
yet be final State policy by the January 31 due date. States that do not have final 
approval for some of these elements or that have not finalized a decision on these 
elements by January 31 should, when completing the Workbook, indicate the status of 
each element which is not yet official State policy and provide the anticipated date by 
which the proposed policy will become effective. In each of these cases, States must 
include a timeline of steps to complete to ensure that such elements are in place by 
May 1 , 2003, and implemented during the 2002-2003 school year. By no later than May 
1 , 2003, States must submit to the Department final information for all sections of the 
Consolidated State Application Accountability Workbook. 

Transmittal Instructions 

To expedite the receipt of this Consolidated State Application Accountability Workbook, 
please send your submission via the Internet as a .doc file, pdf file, rtf or .txt file or 
provide the URL for the site where your submission is posted on the Internet. Send 
electronic submissions to conapp@ed.gov. 

A State that submits only a paper submission should mail the submission by express 
courier to: 

Celia Sims 

U.S. Department of Education 
400 Maryland Ave., SW 
Room 3W300 

Washington, D.C. 20202-6400 
(202) 401-0113 
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PART I: Summary of Required Elements for State Accountability 
Systems 

Instructions 

The following chart is an overview of States' implementation of the critical elements 
required for approval of their State accountability systems. States must provide detailed 
implementation information for each of these elements in Part II of this Consolidated 
State Application Accountability Workbook. 

For each of the elements listed in the following chart, States should indicate the current 
implementation status in their State using the following legend: 

F: State has a final policy, approved by all the required entities in the State (e.g., 

State Board of Education, State Legislature), for implementing this element in its 
accountability system. 

P: State has a proposed policy for implementing this element in its accountability 

system, but must still receive approval by required entities in the State (e.g., 
State Board of Education, State Legislature). 

W: State is still working on formulating a policy to implement this element in its 

accountability system. 
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Summary of Implementation Status for Required Elements of State Accountability Systems 



Status 



Principle 1: All Schools 



State Accountability System Element 



F 1 .1 Accountability system includes all schools and districts in the state. 

F 1 .2 Accountability system holds all schools to the same criteria. 

F 1 .3 Accountability system incorporates the academic achievement standards. 

F 1 .4 Accountability system provides information in a timely manner. 

F 1 .5 Accountability system includes report cards. 

P 1 .6 Accountability system includes rewards and sanctions. 

Pr nciple 2: All Students 

F 2.1 The accountability system includes all students 

F 2.2 The accountability system has a consistent definition of full academic year. 

F 2.3 The accountability system properly includes mobile students. 



Principle 3: Method of AYP Determinations 



F 3.1 Accountability system expects all student subgroups, public schools, and LEAs to reach 

proficiency by 201 3-14. 

3.2 Accountability system has a method for determining whether student subgroups, public 
F schools, and LEAs made adequate yearly progress. 

F 3.2a Accountability system establishes a starting point. 

F 3.2b Accountability system establishes statewide annual measurable objectives. 

F 3.2c Accountability system establishes intermediate goals. 

Pr nciple 4: Annual Decisions 

F 4.1 The accountability system determines annually the progress of schools and districts. 



STATUS Legend: 

F - Final state policy 

P - Proposed policy, awaiting State approval 
W - Working to formulate policy 
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Principle 5: Subgroup Accountability 

5.1 The accountability system includes all the required student subgroups. 

5.2 The accountability system holds schools and LEAs accountable for the progress of student 

subgroups. 

5.3 The accountability system includes students with disabilities. 

5.4 The accountability system includes limited English proficient students. 

5.5 The State has determined the minimum number of students sufficient to yield statistically 

reliable information for each purpose for which disaggregated data are used. 

5.6 The State has strategies to protect the privacy of individual students in reporting 
achievement results and in determining whether schools and LEAs are making adequate 
yearly progress on the basis of disaggregated subgroups. 

Pr nciple 6: Based on Academic Assessments 

F 6.1 Accountability system is based primarily on academic assessments. 

Pr nciple 7: Additional Indicators 

F 7.1 Accountability system includes graduation rate for high schools. 

F 7.2 Accountability system includes an additional academic indicator for elementary and middle 

schools. 

F 7.3 Additional indicators are valid and reliable. 

Pr nciple 8: Separate Decisions for Readinq/Lanquaqe Arts and Mathematics 

F 8.1 Accountability system holds students, schools and districts separately accountable for 
reading/language arts and mathematics. 

Pr nciple 9: System Validity and Reliability 

P 9.1 Accountability system produces reliable decisions. 

P 9.2 Accountability system produces valid decisions. 

F 9.3 State has a plan for addressing changes in assessment and student population. 

Pr nciple 10: Participation Rate 

F 10.1 Accountability system has a means for calculating the rate of participation in the statewide 
assessment. 

F 10.2 Accountability system has a means for applying the 95% assessment criteria to student 
subgroups and small schools. 

STATUS Legend: 

F - Final policy 

P - Proposed Policy, awaiting State approval 
W- Working to formulate policy 
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PART II: State Response and Activities for Meeting State 
Accountability System Requirements 



Instructions 

In Part II of this Workbook, States are to provide detailed information for each of the 
critical elements required for State accountability systems. States should answer the 
questions asked about each of the critical elements in the State's accountability system. 
States that do not have final approval for any of these elements or that have not 
finalized a decision on these elements by January 31 , 2003, should, when completing 
this section of the Workbook, indicate the status of each element that is not yet official 
State policy and provide the anticipated date by which the proposed policy will become 
effective. In each of these cases, States must include a timeline of steps to complete to 
ensure that such elements are in place by May 1, 2003, and implemented during the 
2002-2003 school year. By no later than May 1 , 2003, States must submit to the 
Department final information for all sections of the Consolidated State Application 
Accountability Workbook. 
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PRINCIPLE 1. A single statewide Accountability System applied to all public 
schools and LEAs. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .1 How does the State 
Accountability System 
include every public 
school and LEA in the 
State? 


Every public school and LEA is required 
to make adequate yearly progress and is 
included in the State Accountability 
System. 

State has a definition of “public school” 
and “LEA” for AYP accountability 
purposes. 

• The State Accountability System 
produces AYP decisions for all 
public schools, including public 
schools with variant grade 
configurations (e.g. , K-12), public 
schools that serve special 
populations (e.g., alternative public 
schools, juvenile institutions, state 
public schools for the blind) and 
public charter schools. It also holds 
accountable public schools with no 
grades assessed (e.g., K-2). 


A public school or LEA is not 
required to make adequate 
yearly progress and is not 
included in the State 
Accountability System. 

State policy systematically 
excludes certain public 
schools and/or LEAs. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 1.1 

Wyoming’s accountability system includes every public school and LEA in the state. According 
to Wyoming Statute 21-2-304 (a), every Wyoming public school student enrolled in fourth, 
eighth, and eleventh grades is required to participate in the Wyoming Comprehensive 
Assessment System (WyCAS) and be assessed in reading, writing, and mathematics. This 
requirement is further supported by Wyoming State Board Rules, Chapter 6. All institutions 
serving neglected and delinquent populations are subject to accreditation requirements of the 
Wyoming State Board of Education and are also required to have their students participate in 
WyCAS. 

Until Wyoming fully develops its assessment system so that all students in grades 3-8 are tested 
each year, there will be grade configurations in some Wyoming schools that do not include a 
fourth, eighth, or eleventh grade. In every case, these schools can be “paired” with a school that 
includes a tested grade for purposes of accountability. For example, several LEAs have 
organized their elementary schools so that students attend grade K-2 in one building and then 
move to a different building for grades 3-5. In this case, the AYP results for the 3-5 building 
will be used to hold the K-2 building accountable as well. The rationale for this is quite simple; 
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teachers in the two different buildings need to be communicating across buildings to plan their 
curricular and instructional sequences. Holding both schools equally accountable for the fourth 
grade results should help foster this communication. 

The following is a list of Wyoming schools that do not contain any of the currently assessed 
grades and the school with which they will be paired for accountability purposes. 



School 

ID 


School Name 


Grades 

Served 


Accountability Related School 


School 

ID 


204003 


Manderson Elementary 


5 


Cloud Peak Middle School 


204051 


501002 


Douglas Primary School 


K-2 


Douglas Intermediate School 


501010 


502007 


Glenrock Intermediate School 


5-6 


Glenrock Middle School 


502050 


701001 


Hudson Elementary 


K-3 


West Elementary 


701 004 


801007 


Lincoln Elementary 


K-2 


Trail Elementary 


801006 


901004 


Ralph Witters Elementary 


K-3 


Lucerne Elementary 


901003 


1001002 


Clear Creek Elementary 


5 


Clear Creek Middle School 


1001050 


1101022 


Miller Elementary 


5-6 


McCormick Junior High School 


1101052 


1101021 


Lebhart Elementary 


K-2 


Fairview Elementary 


1101013 


1101008 


Corlett Elementary 


K-3 


Churchill Elementary 


1101006 


1201002 


Burgoon Elementary 


K-2 


Kemmerer Elementary 


1201001 


1202001 


Afton Elementary 


K-3 


Osmond Elementary 


1202005 


1601003 


Libbey Elementary 


K-2 


West Elementary 


1601005 


1702050 


Central Middle School 


6-7 


Sheridan Junior High School 


1702051 


1702001 


Beckton Elementary 


K-3 


Highland Park Elementary 


1702003 


2104001 


Mountain View Elementary 


K-2 


Fort Bridger Elementary 


2104002 


2106002 


Urie Elementary 


K-3 


Lyman Elementary 


2106001 


2301003 


Newcastle Elementary K-2 


K-2 


Gertrude Burns Intermediate 


2301001 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1.2 How are all public schools 
and LEAs held to the same 
criteria when making an AYP 
determination? 


All public schools and LEAs are 
systematically judged on the 
basis of the same criteria when 
making an AYP determination. 

If applicable, the AYP definition is 
integrated into the State 
Accountability System. 


Some public schools and LEAs 
are systematically judged on the 
basis of alternate criteria when 
making an AYP determination. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 1.2 

Wyoming uses the same WyCAS test data, the same AYP computational formula, and the same 
decision-making processes regarding accountability decisions for every school and LEA in 
Wyoming. See Principle 3 for an explanation of Wyoming’s AYP methodology. 

At present, Wyoming’s AYP system constitutes the state’s accountability system, and will be 
used to hold every public school and LEA accountable in the 2003-2004 school year. 

Wyoming is continuing its work to build a broader statewide accountability system that fully 
merges AYP and additional state systems. For example, the Wyoming Statewide Task Force on 
Student Assessment and Education Accountability recently recommended the establishment of a 
statewide assessment system that can ensure the most valid, reliable accountability 
determinations to improve student achievement, and a statewide accountability system based on 
AYP and additional state criteria that can best determine both absolute performance and progress 
for improving student achievement for the same students over time. Furthermore, the Wyoming 
State Legislature recently enacted legislation that requires the establishment of a statewide 
assessment system that can best measure individual student performance, including progress over 
time, and a statewide accountability system based on AYP as well as data from Wyoming’s 
Body of Evidence system and other related sources that can improve the reliability of 
accountability determinations. These revised statewide assessment and accountability systems 
are expected to come on line over the next two years, as Wyoming develops its annual state 
assessments for grades 3 through 8. Wyoming will, therefore, likely provide the U.S. 

Department of Education (USED) with additional revisions to its AYP Workbook for 2004-2005 
and/or 2005-2006 as appropriate. 



9 







CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .3 Does the State have, at a 
minimum, a definition of 
basic, proficient and 
advanced student 
achievement levels in 
reading/language arts and 
mathematics? 


State has defined three levels of 
student achievement: basic, 
proficient and advanced 

Student achievement levels of 
proficient and advanced 
determine how well students are 
mastering the materials in the 
State’s academic content 
standards; and the basic level of 
achievement provides complete 
information about the progress of 
lower-achieving students toward 
mastering the proficient and 
advanced levels. 


Standards do not meet the 
legislated requirements. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 1.3 

Wyoming’s standards and assessment system was fully approved in February 2000 by the U.S. 
Department of Education under the Improving America’s Schools Act of 1994 and has been 
included in Wyoming State Board of Education Rules, Chapter 31, since that time as well. 
Wyoming’s achievement standards currently include four levels of performance — below basic, 
basic, proficient, and advanced — in nine content areas. These achievement descriptors were 
constructed and endorsed by representative groups of Wyoming educators and stakeholders to 
represent how well students are performing in relation to the Wyoming content standards. 
Wyoming believes that the state’s achievement standards meet the criterion set forth by USED 
with regard to rigor and clarity. 

In the summer of 2002, Wyoming’s standards in all nine content areas were reviewed and 
revised, and the “partially proficient’’ achievement standard was renamed to “basic.” Further, 
because Wyoming’s standards were benchmarked at grades 4, 8, and 11, committees drafted 
grade-level expectations in language arts and mathematics for grades K-8 so grade-level, 
standards-based assessments could be designed to fulfill the requirements of NCLB. These 
revisions were formally adopted by the Wyoming State Board of Education at its July 2003 
meeting as part of Wyoming State Board of Education Rules, Chapter 31. 



1 System of State achievement standards will be reviewed by the Standards and Assessments Peer 
Review. The Accountability Peer Review will determine that achievement levels are used in determining 
AYP. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .4 How does the State provide 
accountability and adequate 
yearly progress decisions 
and information in a timely 
manner? 


State provides decisions about 
adequate yearly progress in time for 
LEAs to implement the required 
provisions before the beginning of 
the next academic year. 

State allows enough time to notify 
parents about public school choice 
or supplemental educational service 
options, time for parents to make an 
informed decision, and time to 
implement public school choice and 
supplemental educational services. 


Timeline does not provide 
sufficient time for LEAs to 
fulfill their responsibilities 
before the beginning of the 
next academic year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 1.4 

Wyoming’s statewide assessment is administered the last two full weeks of March each year. 

The assessment results are returned by the testing contractor to the State by mid-June each year. 
The Wyoming Department of Education will run the AYP calculations and provide data and 
results to schools and LEAs by July 1 each year. Most schools in Wyoming start school during 
the third or fourth week (most common) of August. 

Wyoming will release the results of the state assessment to schools along with “preliminary” 
AYP determinations on July 1. The AYP determinations will be considered “preliminary” in the 
sense that each LEA will have the opportunity to review its AYP data and appeal its AYP 
determinations, if appropriate, prior to those determinations being released as “final.” The LEAs 
will have a thirty-day review period beginning July 1 st and ending July 30 th in which to appeal 
the AYP data and the AYP determinations. On August 1 st , the AYP determinations become 
final. LEAs containing schools identified for improvement will notify parents approximately 
one month before the beginning of the school year regarding public school choice and/or 
supplemental service options, as applicable. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .5 Does the State 


The State Report Card includes 


The State Report Card does not 


Accountability System 


all the required data elements 


include all the required data 


produce an annual State 


[see Appendix A for the list of 


elements. 


Report Card? 


required data elements]. 


The State Report Card is not 




The State Report Card is 
available to the public at the 
beginning of the academic year. 

The State Report Card is 
accessible in languages of major 
populations in the State, to the 
extent possible. 

Assessment results and other 
academic indicators (including 
graduation rates) are reported by 
student subgroups 


available to the public. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 1.5 

Wyoming fulfills the reporting requirements of No Child Left Behind by producing an annual 
state report card. The reporting mechanism entitled Every Student Counts is Wyoming’s web- 
based annual report card, which contains the required NCLB data elements. Table 1 provides an 
element-by-element analysis of the Wyoming state report card in terms of the NCLB 
requirements, and indicates where each NCLB requirement is currently reported (or will be 
reported beginning with the next report card this fall.) 

In Wyoming, a draft-embargoed report card is sent electronically to each LEA and school by the 
first week of September each year. This report can be used for school improvement planning. 
LEA personnel are then requested to submit a narrative to explain their data and the actions the 
LEA plans to take based on the patterns in the data. Additionally, the LEA personnel use this 
time to ensure the accuracy of the data in the reports. A final web-based report that includes 
these narratives is produced by the end of November each year. LEAs are required to distribute 
these final reports to their parents and community. Providing the report to the LEAs at the 
beginning of the school year serves the important purpose of providing data for school 
improvement planning at a time in the year when LEAs are writing their school improvement 
plans. The state report card is available at: www.kl2.wy.us/stats/wde.esc.show_menu 
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Table 1. Wyoming’s Progress Toward Including the Required Data Elements In Every Student 
Counts (ESC), the Wyoming State Report Card 



Required Element 


Wyoming (WDE) Department of 
Education Response 


Information, in the aggregate, on student achievement at 
each proficiency level on the state academic assessments 
(disaggregated by race, ethnicity, gender, disability 
status, migrant status, English proficiency, and status as 
economically disadvantaged, except that such 
disaggregation shall not be required in a case in which 
the number of students in a category is insufficient to 
yield statistically reliable information or the results 
would reveal personally identifiable information about an 
individual student). 


The information is currently 
reported in the school, LEA, and 
state WyCAS reports and WDE 
made these data initially available 
in ESC in early 2003. New reports 
are released in November of each 
year. 


Information that provides a comparison between the 
actual achievement levels of each student subgroup and 
the State’s annual measurable objectives for each such 
group of students on each of the academic assessments. 


WDE currently reports 
disaggregated results, with the 
comparison to the annual targets. 


The percentage of students not tested (disaggregated by 
the student subgroups), except that such disaggregation 
shall not be required in a case in which the number of 
students in a category is insufficient to yield statistically 
reliable information or the results would reveal 
personally identifiable information about an individual 
student. 


This is currently in the 
disaggregated report for LEAs and 
the state as the percent tested. 


The most recent 2-year trend in student achievement in 
each subject area, and for each grade level, for the 
required assessments. 


The WyCAS Performance Level 
Trend Report includes this 
information. It displays as much 
as 6 years of data. 


Aggregate information on any other indicators used by 
the state to determine the adequate yearly progress of 
students in achieving state academic achievement 
standards disaggregated by student subgroups. 


WDE currently reports subgroup 
graduation trends in ESC at the 
state level and we will add a report 
with trends in the percentage of 
students performing at the below 
basic level (our additional 
academic indicator) in the 2004 
ESC report. 
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Table 1 (continued) 



Required Element 


Wyoming (WDE) Department of 
Education Response 


Graduation rates for secondary school students 
disaggregated by student subgroups. 


WDE currently reports, via ESC, 
subgroup graduation trends at the 
school, LEA, and state level. 
WDE currently does not include 
ELL, Free/Reduced Lunch or 
Migrant data because two more 
years are needed of drop-out 
numbers for these subgroups to be 
able to report graduation rates. 


Information on the performance of local educational 
agencies in the State regarding making adequate yearly 
progress, including the number and names of each school 
identified for school improvement under Section 1116. 


WDE produces a memorandum 
and press release each year with 
the list of schools and LEAs that 
have not made Adequate Yearly 
Progress. 


The professional qualifications of teachers in the state, 
the percentage of such teachers teaching with emergency 
or provisional credentials, and the percentage of classes 
in the state not taught by highly-qualified teachers, in the 
aggregate and disaggregated by high poverty compared 
to low-poverty schools which (for this purpose) means 
schools in the top quartile of poverty and the bottom 
quartile of poverty in the state. 


The profile report provides the 
percentage of classes taught by 
highly-qualified teachers in each 
school. The state profile report 
shows the disaggregated results for 
low and high poverty schools. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .6 How does the State 
Accountability System 
include rewards and 
sanctions for public schools 
and LEAs? 2 


State uses one or more types of 
rewards and sanctions, where 
the criteria are: 

• Set by the State; 

• Based on adequate yearly 
progress decisions; and, 

• Applied uniformly across 
public schools and LEAs. 


State does not implement 
rewards or sanctions for public 
schools and LEAs based on 
adequate yearly progress. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 1.6 

For 2003-2004, Wyoming will have a system of rewards and consequences in place for all public 
schools and LEAs, including NCLB required consequences for Title I schools and LEAs. 
Wyoming is working to fin a li z e its system of rewards and consequences for both Title I and non- 
Title I schools. For example, the Wyoming Statewide Task Force on Student Assessment and 
Education Accountability recently recommended the establishment of a system of rewards and 
consequences that would meet Title I requirements and be largely the same for both Title I and 
non-Title I schools based on their performance under Wyoming’s accountability system. 
Furthermore, the Wyoming State Legislature recently enacted legislation that requires the 
establishment of a transitional plan of rewards and consequences to apply to this year’s 
accountability determinations, and a “permanent” plan to apply for the longer term. The interim 
plan for 2003-2004 rewards and consequences is expected to be fully in place by July 1, 2004. 

At a minimum, consistent with federal law, the interim plan will include all required Title I 
consequences for Title I schools and LEAs that do not meet AYP for two or more consecutive 
years, and require school improvement plans for all Title I and non-Title I schools that fail to 
meet AYP for two or more consecutive years. 



2 The state must provide rewards and sanctions for all public schools and LEAs for making adequate 
yearly progress, except that the State is not required to hold schools and LEAs not receiving Title I funds 
to the requirements of section 1 1 1 6 of NCLB [§200.1 2(b) (40)]. 
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PRINCIPLE 2. All students are included in the State Accountability System. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


2.1 How does the State 
Accountability System 
include all students in the 
State? 


All students in the State are 
included in the State 
Accountability System. 

The definitions of “public school” 
and “LEA" account for all 
students enrolled in the public 
school district, regardless of 
program or type of public school. 


Public school students exist in 
the State for whom the State 
Accountability System makes no 
provision. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 2.1 

All Wyoming public school students enrolled in fourth, eighth, and eleventh grades are required 
to participate in the Wyoming Comprehensive Assessment System (WyCAS) and be assessed in 
reading, writing, and mathematics (W.S. 21-2-304(a)). This requirement is further supported by 
Wyoming State Board Rules, Chapter 6. All Neglected and Delinquent Institutions subject to 
accreditation requirements of the Wyoming State Board of Education are also required to have 
their students participate in WyCAS. 

All students who have been in the school for a full academic year are included in the school’s 
AYP determination. Those who have been in the school for less than a full academic year, but in 
the LEA for more than a year will be included in the LEA AYP accountability determination. 

All students, regardless of how long they have been in the state, will be included in the state 
AYP determination. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


2.2 How does the State define 
“full academic year” for 
identifying students in AYP 
decisions? 


The State has a definition of “full 
academic year” for determining 
which students are to be included 
in decisions about AYP. 

The definition of full academic 
year is consistent and applied 
statewide. 


LEAs have varying definitions of 
“full academic year.” 

The State’s definition excludes 
students who must transfer from 
one district to another as they 
advance to the next grade. 

The definition of full academic 
year is not applied consistently. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 2.2 

Wyoming has defined “full academic year” as being enrolled in the same school and/or LEA on 
October 1 and on the first day of the WyCAS testing window in March. All students who are 
enrolled in a public school or LEA on October 1 and are enrolled on the spring testing date are 
considered to have been in the school or the LEA for a full academic year. Using the October 1 
date provides a reasonable balance in addition to fitting with existing data collections from 
LEAs. The enrollment information is provided by the school for each student on the 
demographic section of the state assessment. Also included in this information is if the student 
has been enrolled in the LEA for a full academic year. This information is provided in order to 
determine if the student is included in the AYP determination for a school as well as the LEA. 
For example, a student may transfer within schools in an LEA and therefore, did not reside in 
any one school for a full academic year but did reside in the LEA for a full academic year. 
While this student would not be included in the AYP calculations for the schools attended, the 
student would be included in the AYP calculation for the LEA. This definition is applied 
statewide. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


2.3 How does the State 
Accountability System 
determine which students 
have attended the same 
public school and/or LEA for 
a full academic year? 


State holds public schools 
accountable for students who 
were enrolled at the same public 
school for a full academic year. 

State holds LEAs accountable for 
students who transfer during the 
full academic year from one 
public school within the district to 
another public school within the 
district. 


State definition requires students 
to attend the same public school 
for more than a full academic 
year to be included in public 
school accountability. 

State definition requires students 
to attend school in the same 
district for more than a full 
academic year to be included in 
district accountability. 

State holds public schools 
accountable for students who 
have not attended the same 
public school for a full academic 
year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 2.3 

The demographic section of the WyCAS Student Response Booklet — which is required to be 
completed by test administrators — includes a field to indicate whether the student has been 
enrolled in the school and in the LEA since October 1. This demographic section is required for 
all students enrolled at the beginning of the testing window. 

The Wyoming Department of Education collects an October 1 “snapshot” (WDE Form 606- 
School Building Demographics) of school and LEA enrollments in Wyoming that includes 
enrollment data on the total number of students and data disaggregated by ethnicity /race, LEP, 
and free/reduced lunch. Through the Principal’s Certification Form, required as part of the 
WyCAS administration, school principals are required to explain any discrepancies between the 
counts on the WyCAS assessment and the October 1 data collection to the Department’s 
satisfaction. The summary information gathered from WyCAS and the October 1 data collection 
is compared for aggregate student counts. 
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PRINCIPLE 3. State definition of AYP is based on expectations for growth in 
student achievement that is continuous and substantial, such that all students 
are proficient in reading/language arts and mathematics no later than 2013-2014. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.1 How does the State’s 

definition of adequate yearly 
progress require all students 
to be proficient in 
reading/language arts and 
mathematics by the 201 3- 
2014 academic year? 


The State has a timeline for 
ensuring that all students will 
meet or exceed the State’s 
proficient level of academic 
achievement in reading/language 
arts 3 and mathematics, not later 
than 2013-2014. 


State definition does not require 
all students to achieve 
proficiency by 2013-2014. 

State extends the timeline past 
the 201 3-2014 academic year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 3.1 

Wyoming’s definition of and timeline for Adequate Yearly Progress requires 100 percent of 
Wyoming students to be proficient by the 2013-2014 school year (see Elements 3.2a and 5.5 for 
more details on Wyoming’s AYP methodology). 



3 If the state has separate assessments to cover its language arts standards (e.g., reading and writing), 
the State must create a method to include scores from all the relevant assessments. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2 How does the State 
Accountability System 
determine whether each 
student subgroup, public 
school and LEA makes 
AYP? 


For a public school and LEA to 
make adequate yearly progress, 
each student subgroup must 
meet or exceed the State annual 
measurable objectives, each 
student subgroup must have at 
least a 95% participation rate in 
the statewide assessments, and 
the school must meet the State’s 
requirement for other academic 
indicators. 

However, if in any particular year 
the student subgroup does not 
meet those annual measurable 
objectives, the public school or 
LEA may be considered to have 
made AYP, if the percentage of 
students in that group who did 
not meet or exceed the proficient 
level of academic achievement 
on the State assessments for that 
year decreased by 1 0% of that 
percentage from the preceding 
public school year; that group 
made progress on one or more of 
the State’s academic indicators; 
and that group had at least 95% 
participation rate on the 
statewide assessment. 


State uses different method for 
calculating how public schools 
and LEAs make AYP. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 3.2 

Under NCLB, schools, LEAs, and the state are required to make AYP on the basis of, among 
other things, subgroup performance. Wyoming’s definition of AYP follows closely the 
specifications laid out in Section 1111 of the No Child Left Behind Act and reiterated in Sections 
200.13-200.21 of the final accountability regulations. 

For each school and LEA to meet the annual AYP performance targets, they must pass several 
tests. Each school/LEA is evaluated to ensure that at least 95 percent of students in all required 
subgroups are tested and included in the accountability system. Once the school/LEA meets the 
95 percent participation requirement, Wyoming’s AYP definition requires each school and LEA 
to be judged against the status achievement target overall and for each subgroup above the 
minimum group size requirement. Finally, the school/LEA must demonstrate success on the 



20 







CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



additional academic indicator. If the school/LEA (or any subgroup above the minimum group 
size requirement) does not meet the AYP status target, the safe harbor provision is examined. 
Additional details of Wyoming’s AYP methodology are found under Elements 3.2a (specific 
calculation methodology for the primary indicator) and 5.5 (minimum group sizes and 
confidence intervals). 

One can think of this process as having basically three indicators for a school/LEA in each 
annual determination of AYP. A school/LEA will be classified as having not met AYP if any 
one of these indicators is found to not meet the stated AYP goals. These three indicators are: 

1 . language arts participation rate and language arts percent proficient and advanced 

2. mathematics participation rate and mathematics percent proficient and advanced 

3. other academic indicator 

The language arts and mathematics indicators (participation rate and percent proficient and 
advanced) can be activated if any of nine groups fail to meet the stated AYP goals. These groups 
are: 

1. All students 

2. Free/reduced lunch (economically disadvantaged) 

3. Native American 

4. Hispanic 

5. Asian 

6. African American 

7. White 

8. IEP (students with disabilities) 

9. LEP 

In addition, the school/LEA will be examined using the additional indicator to determine AYP, 
with subgroup data examined where safe harbor is examined. 

For a school to be placed into the school improvement cycle it must miss AYP for two 
consecutive years for any subgroup based on the same indicator. For example, if a school does 
not meet AYP in mathematics in year 1 (in terms of either participation rate or percent proficient 
and advanced), the school fails to meet AYP based on that indicator. However, if in year 2 the 
school meets AYP in mathematics, but does not meet AYP in language arts or the other 
academic indicator, the school would fail to meet AYP based on that indicator in year 2 but has 
not failed to meet AYP for two consecutive years such that the school improvement cycle would 
be initiated. This rule will help ensure the reliability of AYP judgments by reducing the 
likelihood of a single, invalid judgment placing a school in improvement status. It will also 
ensure that schools have one year to focus on a specific AYP issue and address that issue before 
being placed in improvement. 

This data regarding school/LEA accountability will be managed through data systems currently 
under construction to accommodate the requirements of examining schools and LEAs for AYP 
determinations. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2a What is the State’s starting 
point for calculating 
Adequate Yearly 
Progress? 


Using data from the 2001-2002 
school year, the State 
established separate starting 
points in reading/language arts 
and mathematics for measuring 
the percentage of students 
meeting or exceeding the State’s 
proficient level of academic 
achievement. 

Each starting point is based, at a 
minimum, on the higher of the 
following percentages of students 
at the proficient level: (1 ) the 
percentage in the State of 
proficient students in the lowest- 
achieving student subgroup; or, 
(2) the percentage of proficient 
students in a public school at the 
20 th percentile of the State’s total 
enrollment among all schools 
ranked by the percentage of 
students at the proficient level. 

A State may use these 
procedures to establish separate 
starting points by grade span; 
however, the starting point must 
be the same for all like schools 
(e.g., one same starting point for 
all elementary schools, one same 
starting point for all middle 
schools...). 


The State Accountability System 
uses a different method for 
calculating the starting point (or 
baseline data). 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 3.2a 

1. In order to calculate a more stable baseline estimate of a school’s performance, Wyoming 
combined two years of data to calculate the starting points for AYP. The baseline is 
based on school’s average percent proficient and advanced across 2001 and 2002. 

2. Instruction and assessment of writing, as one of the language arts standards, has a long 
history in Wyoming; therefore, it is felt that it is appropriate to include writing results in a 
language arts composite score instead of having a result that focuses solely on reading. 
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This language arts composite score is the average of each student’s reading and writing 
scores. Because the scale scores for reading and writing have slightly different standard 
deviations, simply averaging the two scores is not as accurate as standardizing the scores 
first. This standardization was completed utilizing equipercentile equating as follows: 

a. Two hundred forty (240; the cutscore for proficient) was subtracted from 
each student’s WyCAS scale score and divided by the standard deviation for that 
specific WyCAS distribution (done separately for reading and writing). This has 
the effect of creating a score distribution where the zero point is the cutscore 
proficient and advanced/basic and below basic (this is like a z-score). In 
mathematical terms: 

WyCAS Std Score = (WyCAS score - 240) 

WyCAS Std. Dev. 

This procedure converts each of the two scales to a scale where a score of zero or 
above is considered proficient and a negative score is below proficient. This 
procedure was completed for each of the three WyCAS tests (reading, writing, 
and mathematics). 

b. The two WyCAS language arts standardized scores (reading and writing) 
were averaged to create a language arts composite score. 

c. The percentile rank for reading and writing at the boundaries of the 

cut scores for the proficiency levels were located. These specific percentiles for 
reading and writing were then averaged to locate on the distribution of the 
standard scores where the boundaries would be for the achievement levels of the 
language arts composite score. 

d. With the cut scores located for the language arts composite scores, 
student’s individual performance can then be classified as below basic, basic, 
proficient, or advanced. 



3. The law requires that students be in a particular school or LEA for a “full academic year” 
to be included in the calculation of AYP for the school or LEA, respectively. This filter 
was applied based on information collected on the WyCAS student response booklets for 
the baseline year, but as described above Wyoming intends to use additional means for 
collecting this information in subsequent years. 

4. Starting points (initial achievement targets) were calculated using the 20 th percentile 
method as outlined in Section 1111 of NCLB. Schools were rank-ordered by percent 
proficient and above and then the enrollment was counted from the lowest-performing 
school until 20 percent of the students were counted. The percent proficient and 
advanced in the school where the 20 th percentile student was located was considered the 
starting point. The starting points for language arts and mathematics were calculated 
separately. The calculated starting points for percent proficient and advanced in 
mathematics and language arts will be used to hold all subgroups accountable. The 
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following table provides the specific starting points for schools and LEAs in language 
arts and mathematics. 

AYP Starting Points for Wyoming Schools (% Proficient and Advanced) 





Language Arts 


Mathematics 


4 th Grade 


30.4% 


23.8% 


8 th Grade 


34.5% 


25.3% 


11 th Grade 


48.4% 


35.8% 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2b What are the State’s annual 
measurable objectives for 
determining adequate yearly 
progress? 


State has annual measurable 
objectives that are consistent 
with a state’s intermediate goals 
and that identify for each year a 
minimum percentage of students 
who must meet or exceed the 
proficient level of academic 
achievement on the State’s 
academic assessments. 

The State’s annual measurable 
objectives ensure that all 
students meet or exceed the 
State’s proficient level of 
academic achievement within the 
timeline. 

The State’s annual measurable 
objectives are the same 
throughout the State for each 
public school, each LEA, and 
each subgroup of students. 


The State Accountability System 
uses another method for 
calculating annual measurable 
objectives. 

The State Accountability System 
does not include annual 
measurable objectives. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 3.2b 

See the discussion of annual measurable objectives within the context of the discussion of 
Element 3.2c. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2c What are the State’s 


State has established 


The State uses another method 


intermediate goals for 
determining adequate 


intermediate goals that increase 
in equal increments over the 


for calculating intermediate goals. 


yearly progress? 


period covered by the State 
timeline. 

• The first incremental 

increase takes effect not 
later than the 2004-2005 
academic year. 

• Each following incremental 

increase occurs within 
three years. 


The State does not include 
intermediate goals in its definition 
of adequate yearly progress. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 3.2c 

Wyoming’s intermediate goals (in bold) and annual measurable objectives are presented in Table 
2. Wyoming has chosen to use six (6) intermediate goals so that each expected increase in 
performance is one-sixth of the difference between 100 percent and each starting point for 
language arts and mathematics by grade span. Recognizing that building school and LEA 
capacity is generally non-linear, and organizations engaged in reform often experience a 
“performance dip” prior to substantial improvement (Fullan, 2001), Wyoming has decided to use 
a non-linear approach for increasing performance expectations for Wyoming schools and LEAs. 
Therefore, Wyoming will increase performance targets one-sixth of the difference between the 
starting point and 100 percent for the 2004-2005 school year and again each year in 2007-2008, 
2010-2011, 2011-2012, 2012-2013, and 2013-2014 so that the approach reflects 100 percent of 
the students being proficient or advanced in both content areas for all three grade spans. The 
annual measurable objectives are the same performance targets as the most proximate prior 
intermediate goal. 

The non-linear approach for intermediate goals is appropriate due to the multiple demands that 
will initially be placed on the Wyoming educational system in a short time frame. Wyoming has 
adopted revised content and achievement standards for mathematics and language arts for grades 
kindergarten through eight and eleven. The prior standards were for grades four, eight, and 
eleven and these new expanded standards will take time for adoption and integration into the 
classroom. Student achievement results that relate to these standards are expected to increase 
less in the initial stages of implementation and alignment of classroom instruction, with greater 
increases in later years. 
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In addition, Wyoming is in the process of developing and implementing additional assessments 
to ensure annual testing grades 3-8. This new system will also be more likely to perceive change 
after schools and classrooms have had time to fully align their educational programs with the 
content and achievement standards. By allowing for a steeper trajectory in later years, 
professional development and school based interventions will have an opportunity to take effect, 
and the AYP accountability system in Wyoming will be more valid, reliable, and meaningful. 



Table 2. Wyoming’s AYP Intermediate Goals (bold) and Annual Objectives. 





Elementary School 


Middle School 


High School 


Year 


Language Arts 


Mathematics 


Language Arts 


Mathematics 


Language Arts 


Mathematics 


2002 


30.40 


23.80 


34.50 


25.30 


48.40 


35.80 


2003 


30.40 


23.80 


34.50 


25.30 


48.40 


35.80 


2004 


30.40 


23.80 


34.50 


25.30 


48.40 


35.80 


2005 


42.00 


36.50 


45.42 


37.75 


57.00 


46.50 


2006 


42.00 


36.50 


45.42 


37.75 


57.00 


46.50 


2007 


42.00 


36.50 


45.42 


37.75 


57.00 


46.50 


2008 


53.60 


49.20 


56.33 


50.20 


65.60 


57.20 


2009 


53.60 


49.20 


56.33 


50.20 


65.60 


57.20 


2010 


53.60 


49.20 


56.33 


50.20 


65.60 


57.20 


2011 


65.20 


61.90 


67.25 


62.65 


74.20 


67.90 


2012 


76.80 


74.60 


78.17 


75.10 


82.80 


78.60 


2013 


88.40 


87.30 


89.08 


87.55 


91.40 


89.30 


2014 


100.00 


100.00 


100.00 


100.00 


100.00 


100.00 



27 






CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



PRINCIPLE 4. State makes annual decisions about the achievement of all public 
schools and LEAs. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


4.1 How does the State 
Accountability System 
make an annual 
determination of whether 
each public school and LEA 
in the State made AYP? 


AYP decisions for each public 
school and LEA are made 
annually. 4 


AYP decisions for public schools 
and LEAs are not made annually. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 4.1 

Wyoming established a baseline for AYP using two years of data and will make AYP decisions 
using annual student achievement data obtained from the state assessment system. The 
establishment of the baseline utilized two years of data to ensure a reliable initial target for all 
Wyoming schools. Annual decisions for school and LEA accountability will use the current 
year’s assessment data obtained in the March assessment window. The use of one year of 
assessment data will allow the AYP indicator to be more sensitive to annual changes in 
classrooms and schools and more meaningfully reflect adequate yearly progress. In cases where 
a school or LEA does not meet AYP based on one year of data, Wyoming will make a secondary 
examination based on averaged data from the current year and the prior year to determine if the 
given school/LEA made AYP. This will help correct for potential anomalies based on cohort 
variability where such performance may not be indicative of the overall school/LEA 
performance (which is especially important in states such as Wyoming that have small group 
sizes). 

When the new three through eight assessment system is operational, achievement data for all 
grades contained within a school will be aggregated and will allow for more reliable and valid 
inferences regarding school effectiveness due to the increase in sample size. 



4 Decisions may be based upon several years of data and data may be averaged across grades within a 
public school [§1111 (b)(2)(J)]. 
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PRINCIPLE 5. All public schools and LEAs are held accountable for the 
achievement of individual subgroups. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.1 How does the definition of 
adequate yearly progress 
include all the required 
student subgroups? 


Identifies subgroups for defining 
adequate yearly progress: 
economically disadvantaged, 
major racial and ethnic groups, 
students with disabilities, and 
students with limited English 
proficiency. 

Provides definition and data 
source of subgroups for adequate 
yearly progress. 


State does not disaggregate data 
by each required student 
subgroup. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 5.1 

NCLB requires an intense focus on all subgroups of students, and the AYP results for each 
school and LEA are based upon all subgroups meeting the target performance levels. All 
subgroups will use the same achievement targets for mathematics and language arts. These 
achievement targets are presented in Table 2 and in element 3.2a. 

Since Wyoming’s definition of AYP follows closely the specifications of Section 1111 of NCLB 
and Sections 200.13-200.21 of the final accountability regulations, the definition of AYP is 
based on the performance of all required subgroups. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.2 How are public schools 
and LEAs held 
accountable for the 
progress of student 
subgroups in the 
determination of adequate 
yearly progress? 


Public schools and LEAs are held 
accountable for student subgroup 
achievement: economically 
disadvantaged, major ethnic and 
racial groups, students with 
disabilities, and limited English 
proficient students. 


State does not include student 
subgroups in its State 
Accountability System. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 5.2 

Schools and LEAs are required to meet the achievement targets or safe harbor requirements for 
all required subgroups as specified in section 1111 of NCLB. Further, by reporting 
disaggregated performance for each school and LEA, Wyoming citizens will also be able to hold 
schools and LEAs accountable for the performance of all identifiable subgroups. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.3 How are students with 
disabilities included in the 
State’s definition of 
adequate yearly progress? 


All students with disabilities 
participate in statewide 
assessments: general 
assessments with or without 
accommodations or an alternate 
assessment based on grade level 
standards for the grade in which 
students are enrolled. 

State demonstrates that students 
with disabilities are fully included 
in the State Accountability 
System. 


The State Accountability System 
or State policy excludes students 
with disabilities from participating 
in the statewide assessments. 

State cannot demonstrate that 
alternate assessments measure 
grade-level standards for the 
grade in which students are 
enrolled. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 5.3 

All students, including students with disabilities, will be included in Wyoming’s accountability 
system for calculating AYP. Students with disabilities must participate in the Wyoming 
Comprehensive Assessment System (WyCAS) in one of three ways: 

1. In the general assessment with no accommodations; 

2. In the general assessment with accommodations; or 

3. In the alternate assessment (WyCAS-Alt) for the most significantly cognitively 
disabled students. 

Wyoming’s alternate assessment is a portfolio-type system that is scored by special education 
teachers. Wyoming has documented success in maintaining a high participation rate — while the 
average participation rate is over 99 percent, the modal participation rate is 100 percent. 
Wyoming’s approach is best serving the state’s most severely disabled students while 
maintaining a fair and valid accountability system. 

In accordance with USED regulations , Wyoming will use its alternative achievement standards 
in language arts and mathematics to calculate AYP only for students with the most significant 
cognitive disabilities, who take the alternate assessment. These alternative standards are aligned 
with Wyoming’s academic content standards and reflect the professional judgment of the highest 
learning standards possible for those students. Wyoming will include up to 1 percent of students 
with disabilities in the accountability system based on performance on the state’s alternate 
assessment at the LEA and state levels (with requests for LEA exceptions reviewed by the 
Wyoming Department of Education on a case-by-case basis per USED regulations). (In 2004, 
less than 0.73 percent of Wyoming’s student population was assessed with the alternate 
assessment.) Wyoming will modify this policy as necessary in future years to reflect any 
changes in the regulations or in Wyoming’s alternate assessment system. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.4 How are students with 
limited English proficiency 
included in the State’s 
definition of adequate 
yearly progress? 


All LEP student participate in 
statewide assessments: general 
assessments with or without 
accommodations or a native 
language version of the general 
assessment based on grade level 
standards. 


LEP students are not fully 
included in the State 
Accountability System. 




State demonstrates that LEP 
students are fully included in the 
State Accountability System. 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 5.4 

All students, including LEP students, are included in Wyoming’s accountability system for 
calculating AYP. No students are exempted from participating in the statewide assessment 
system on the basis of LEP status. Similar to the rules for students with disabilities, all LEP 
students must participate in the WyCAS with accommodations as appropriate. 

The majority of LEP students participate in the WyCAS with appropriate accommodations. 

There are no alternative-language versions of the WyCAS. All LEP students are included in the 
statewide assessments in language arts and mathematics, including those LEP students who have 
been enrolled in U.S. schools for less than one year, and must be assessed with accommodations 
when appropriate. These directions were reiterated to all LEAs through statewide assessment 
administration workshops prior to the state assessment. Per recent USED guidance, “States may, 
but would not be required to, include results [of LEP students in their first year in U.S. schools] 
from the mathematics and, if given, the reading/language arts content assessments in Adequate 
Yearly Progress (AYP) calculations.” Therefore, Wyoming will not include the scores of first 
year LEP students. Such LEP students will be included in participation rate determinations. 

Wyoming uses the definition of LEP contained in NCLB §9101 for purposes of determining 
what students are included in the LEP subgroup for AYP accountability. Wyoming utilizes an 
identification process which includes an assessment to determine whether a student falls within 
that LEP definition. For AYP calculations, per recent USED guidance, Wyoming will include in 
the LEP subgroup the scores of students who have attained English proficiency within the last 
two years. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.5 What is the State's 

definition of the minimum 
number of students in a 
subgroup required for 
reporting purposes? For 
accountability purposes? 


State defines the number of 
students required in a subgroup 
for reporting and accountability 
purposes, and applies this 
definition consistently across the 
State. 5 

Definition of subgroup will result in 
data that are statistically reliable. 


State does not define the required 
number of students in a subgroup 
for reporting and accountability 
purposes. 

Definition is not applied 
consistently across the State. 

Definition does not result in data 
that are statistically reliable. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 5.5 

Reporting Purposes 

The minimum number of students in a subgroup required for reporting purposes in Wyoming is 
six (6). This definition of subgroup size is used consistently across the state for reporting 
purposes. 

Accountability Purposes 

For accountability decisions, the minimum number of students is set at thirty (30). This 
minimum sample size assures that reliable and valid decisions are made about school and LEA 
effectiveness. Subgroup results with fewer than thirty (30) students in the assessed grade level 
are not included in AYP calculations based on the performance of that particular subgroup. The 
members of the subgroup are included in the AYP calculations for the entire school and LEA. 
This definition of group size of thirty (30) is used consistently across the state for accountability 
purposes. 

Schools with fewer than thirty (30) students assessed among all students would fall below the 
minimum number, therefore precluding a reliable AYP determination. Wyoming expects to 
create a broader system of assessment and accountability in the future that will include AYP and 
additional data resources for making more valid and reliable accountability decisions for these 
small schools containing less than 30 students in the assessed grades. In addition, the number of 
schools with fewer than 30 students assessed will decrease substantially once state assessments 
are in place for grades 3-8 in the 2005-2006 school year. However, recognizing that Wyoming 
has a sizable number of schools below the minimum number at the present time, Wyoming will 
adopt an interim rule for small schools, whereby schools with fewer than 30 assessed students 
will be evaluated to determine AYP for the school overall based on a minimum number of 6. 



5 The minimum number is not required to be the same for reporting and accountability. 
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During this interim period only, schools with fewer than 6 test scores will be reviewed based on 
averaged data over the previous 2-3 years, which is designed to reach at least 6 test scores. If 
any schools remain, they will be reviewed on a case-by-case basis so that all schools are included 
in AYP. (Per Element 1.1, schools with no grades tested will be paired with other schools for 
AYP accountability.) Wyoming expects to present its revised statewide accountability system as 
early as the 2004-2005 school year. 

The WDE will also use a confidence interval approach to determine AYP to account for small 
sample sizes, to ensure the most valid and reliable accountability decisions, and to assure that 
decisions are based on statistically significant results. Wyoming believes that this approach 
allows all schools and LEAs to be held accountable in the most reliable and valid way possible. 



a. Wyoming used a one-tailed, 95 percent confidence interval to judge whether or 
not schools were significantly different than the performance target 6 . To 
approximate this calculation one could use the following formula to first calculate 
the standard error (SE) of the proportion 7 : 

L liAzE 

V n 

ii. Where p is equal to the proportion (ranging from 0 to 1) scoring proficient 
and advanced and n is the number of students tested 

iii. Multiply the standard error by 1.645 to arrive at the one-tailed, 95 percent 
confidence interval. Add (or subtract) this standard error to the percent 
proficient and advanced for the schools to arrive at the confidence interval. 

b. If the confidence interval (margin of error) reaches above the statewide 
performance target, the school would be considered to have “met AYP.” The 
following diagram illustrates how this works. 



Performance 

Target 



In this example School X would have “made AYP” and School Y would have 
“not met AYP.” This confidence interval approach will be used for AYP status 
decisions for the school and LEA overall as well as the subgroup AYP decisions. 

c. For schools and LEAs not meeting the state AYP achievement targets, the next 
step in the methodology is to examine “safe harbor” provisions. Wyoming is 
proposing the incorporation of a 75% confidence interval with a .25 alpha for the 
safe harbor examination in order to make this provision more reliable and valid 
for the unique circumstances encountered in Wyoming. 
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The use of a confidence interval in safe harbor would take into account the 
inherent variability that is exhibited from year to year in the percent of students 
scoring proficient and non-proficient, which is particularly important given the 
relatively small group sizes in Wyoming and other rural states in which extreme 
changes can be seen with only a “real” change of 2 or 3 students. 

The use of a confidence interval would basically address the question, “Has the 
school/LEA made a decrease in the number of non-proficient students that is 
statistically equivalent to 10 percent?” One potential (although not technical) 
problem with this approach is that it could permit a school that actually had an 
increase in the number of non-proficient students to meet “safe harbor.” To 
prevent this occurrence, and promote the most valid, reliable, and appropriate 
AYP safe harbor determinations, Wyoming proposes to use a confidence interval 
for the examination of safe harbor with the modification of only allowing the use 
of a confidence interval if the school/LEA has made an actual decrease in the 
percent of non-proficient students. Schools/LEAs that did not decrease the 
percent of non-proficient students would not qualify for the safe harbor provision 
in alignment with federal law. It is felt that this is a more valid way of utilizing 
the safe harbor provision rather than the broad application of a confidence interval 
to all entities under safe harbor. Keep in mind also that in order to qualify for 
safe harbor, a school/LEA must have made progress on the additional indicator, 
which in Wyoming means, reducing the percentage of the lowest performing 
students in reading in elementary and middle school and/or on improving 
graduation rate in high school. 



References 

6 Arce-Ferrer, A., Frisbie, D.A., & Kolen, MJ. (2002). Standard Errors of Proportions Used in 
Reporting Changes in School Performance With Achievement Levels. Educational Assessment, 
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Methods, http://www.itl.nist.gov/div898/handbook/, December 18, 2002. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.6 How does the State 
Accountability System 
protect the privacy of 
students when reporting 
results and when 
determining AYP? 


Definition does not reveal 
personally identifiable 
information. 6 


Definition reveals personally 
identifiable information. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 5.6 

With a minimum group size for reporting of six (6) per year, Wyoming is able to protect the 
identity of individual students. The Wyoming Department of Education has developed 
“masking” approaches to hide the identity of students when all students score in the same 
performance category. On all of the disaggregated reports, performance levels are restricted to 
be within 5 percent and 95 percent proficient. This protects the individual identification of 
student performance when all students perform at the same level. 



6 The Family Education Rights and Privacy Act (FERPA) prohibits an LEA that receives Federal funds 
from releasing, without the prior written consent of a student’s parents, any personally identifiable 
information contained in a student’s education record. 



36 






CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



PRINCIPLE 6. State definition of AYP is based primarily on the State’s academic 
assessments. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


6.1 How is the State’s 
definition of adequate 
yearly progress based 
primarily on academic 
assessments? 


Formula for AYP shows that 
decisions are based primarily on 
assessments. 7 

Plan clearly identifies which 
assessments are included in 
accountability. 


Formula for AYP shows that 
decisions are based primarily on 
non-academic indicators or 
indicators other than the State 
assessments. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 6.1 

The methodology for calculating AYP has been described elsewhere in this document and, as 
shown, Wyoming’s definition of AYP is based primarily (with the exception of graduation 
requirements) on the statewide academic assessment system, WyCAS. 



7 State Assessment System will be reviewed by the Standards and Assessments Peer Review Team. 
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PRINCIPLE 7. State definition of AYP includes graduation rates for public High 
schools and an additional indicator selected by the State for public Middle and 
public Elementary schools (such as attendance rates). 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.1 What is the State definition 
for the public high school 
graduation rate? 


State definition of graduation rate: 

• Calculates the percentage 
of students, measured 
from the beginning of the 
school year, who graduate 
from public high school 
with a regular diploma (not 
including a GED or any 
other diploma not fully 
aligned with the state’s 
academic standards) in 
the standard number of 
years; or, 

• Uses another more 
accurate definition that 
has been approved by the 
Secretary; and 

• Must avoid counting a 
dropout as a transfer. 

Graduation rate is included (in the 
aggregate) for AYP, and 
disaggregated (as necessary) for 
use when applying the exception 
clause 8 to make AYP. 


State definition of public high 
school graduation rate does not 
meet these criteria. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 7.1 

Wyoming’s graduation rate for AYP is defined as the total number of graduates divided by the 
total number of students who left school, including students who completed high school and 
drop-outs from that class over the past four years. 

The rate incorporates 4 years worth of data and thus, is an estimated cohort rate. It is calculated 
by dividing the number of students who receive a regular diploma by the sum of dropouts from 
grade 9 through 12 in consecutive years, plus the number of students completing high school. If 



See USC 631 l(b)(2)(I)(i), and 34 C.F.R. 200.20(b) 



38 






CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



a hypothetical graduating class began as 9th graders in Year 1, this 4-year completion rate would 
look like: 



Students Receiving a Regular Diploma in Year 4 

Dropouts (Grade 9 Year 1 + Grade 10 Year 2 + Grade 1 1 Year 3 + Grade 12 Year 4) + Students Completing High School Year 4 

This formula used by the Wyoming Department of Education for calculating graduation rates is 
an “exiter” rate. The denominator is the total of all “exiters” from a school over a 4 year period 
for a grade cohort. The exiters are the 9th grade drop-outs 3 years ago, the 10th grade drop-outs 
2 years ago, 11th grade drop-outs last year, and this year’s 12th grade drop-outs plus completers. 
These are all the students that “exited” from education for that cohort. The numerator is the 
count of this year’s regular diploma recipients. The rate gives “What percent of students exiting 
education do so with a regular diploma?” 9 

Historically, Wyoming did not collect disaggregated graduation information to the extent 
prescribed by NCLB. Wyoming collected the race/ethnicity and the gender of graduates and 
drop-outs, but did not gather disaggregated data for LEP or free/reduced lunch eligible students. 
Special education students have their own “exiter” collection. The department did implement the 
collection of additional disaggregation with the 2001-2002 school year data collection cycle. 
However, it will take three more years for the Department to be able to calculate disaggregated 
graduation rates for LEP or free/reduced lunch eligible students. 

If a school fails to meet the annual student performance goal for any subgroup, growth on the 
graduation rate for that subgroup will be required for the school to make “safe harbor.” In those 
cases where disaggregated data are not yet available at the state level, the school failing to make 
AYP will have the opportunity to go back in time to compile the disaggregated drop-out data to 
calculate graduation rate for AYP. 

LEAs currently report drop-outs using the above definition. Students who transfer are not 
currently included in the graduation rate calculation. Wyoming is in the initial stages of 
developing a system that will allow the tracking of individual students, which would allow the 
state to verify LEA reports and more accurately track transfers and drop-outs. The Wyoming 
Department of Education received initial funding from the Wyoming legislature to start 
implementing a state education data system. However, it will be several years before student 
level data is available at the department from all schools and districts. Until then the Wyoming 
Department of Education will continue to train LEA staff in how to report drop-out and 
completion data. The Department will continue to review the reported data for consistency 
within the collection (i.e., proportions within race/ethnic categories are reasonable, cell sizes are 
consistent with enrollments, etc.) and trends are within reason. 

Finally, Wyoming will adopt a rule regarding graduation rate that is specific to students with 
disabilities. Per USED guidance, a student with disabilities who receives a regular diploma 
within the period specified by that student’s IEP team will be considered to have received a 
regular diploma “within the standard number of years,” and will be included in the graduation 
rate. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.2 What is the State’s 
additional academic 
indicator for public 
elementary schools for the 
definition of AYP? For 
public middle schools for 
the definition of AYP? 


State defines the additional 
academic indicators, e.g., 
additional State or locally 
administered assessments not 
included in the State assessment 
system, grade-to-grade retention 
rates or attendance rates. 9 


State has not defined an 
additional academic indicator for 
elementary and middle schools. 




An additional academic indicator 
is included (in the aggregate) for 
AYP, and disaggregated (as 
necessary) for use when applying 
the exception clause to make 
AYP. 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 7.2 

In reviewing other state plans, Wyoming became concerned about the efficacy and validity of 
using indicators such as attendance rates as the additional indicator for elementary and middle 
schools. Therefore, Wyoming has carried forward a very successful component of its IASA 
AYP system designed to focus attention on the lowest performing students. 

Wyoming was concerned about the potential negative consequences that might result if 
schools/LEAs focus on those students scoring just below the proficient cutscore and do not 
attend to the truly lowest scoring students. Therefore, Wyoming proposes to use the reduction in 
the percentage of students scoring in the below basic performance category (the state’s lowest 
category) in reading as the additional academic indicator for elementary and middle schools. A 
school will not be able to make safe harbor if it has a statistically significant increase in the 
percentage of students scoring in the lowest performance category in reading. 



9 NCLB only lists these indicators as examples. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.3 Are the State’s academic 


State has defined academic 


State has an academic indicator 


indicators valid and 


indicators that are valid and 


that is not valid and reliable. 


reliable? 


reliable. 


State has an academic indicator 




State has defined academic 


that is not consistent with 




indicators that are consistent with 
nationally recognized standards, if 


nationally recognized standards. 




any. 


State has an academic indicator 
that is not consistent within grade 
levels. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 7.3 

Reliability of additional indicator in public elementary schools and middle schools 

In order to reliably determine whether or not a school/LEA has had a reduction in the percentage 
of students scoring in the below basic category, Wyoming will apply a statistical confidence 
interval to those schools failing to demonstrate a reduction in the percentage of students scoring 
in the below basic category to determine if the difference in the proportions is due to factors 
other than chance. Using this statistical methodology will help ensure the reliability of AYP 
decisions. 

The methodology for determining if a school or LEA has made progress on the additional 
indicator for elementary school and middle school will proceed as follows: 

1. The percent of students scoring below basic in reading in the prior year will be 
subtracted from the school’s current year percent reading below basic. This indicator will be 
negative for schools demonstrating a reduction in the percent of below basic (an indicator that is 
constant (zero) will be considered as non-increasing and therefore adequate). A positive 
indicator shows that a school has had an increase in the percent reading below basic. 

2. Small schools with less than six (6) students in either year’s assessment will be 
examined in comparison to past progress to ensure a valid decision has been made 
due to the possibility of high variability with small sample sizes. 

3. If in both the current year and the prior year, a school’s percentage of students 
scoring below basic in reading is below 15 percent, fluctuations in the percentage 
of students scoring below basic will not be considered sufficient evidence to show 
failure on the additional indicator. Said differently, schools with 85 percent or 
more of students above below basic in reading in both years can meet the 
additional indicator regardless of fluctuations. This 15 percent bar can be 
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justified by examining results from prior years NAEP assessment and the related 
percent of below basic students. In the 2003 NAEP reading results, 
approximately 38 percent of Wyoming 4 th grade students were classified as below 
basic and approximately 28 percent of Wyoming 8 th grade students were 
classified as below basic. Therefore, a school having below 15 percent of their 
students’ below basic in reading in consecutive years is superior in comparison to 
a large proportion of the state. 

4. Schools that exhibit an increase in the percent of students scoring below basic will 
be further examined utilizing a confidence interval. A confidence interval is 
appropriate because this determination is based on an assessment result that 
contains error due to annual variability in the student population. This will be 
used to ascertain the error surrounding this estimator. If the calculated confidence 
interval spans into negative percentages, this will provide evidence that the 
school’s indicator may show reduction in the percent below basic with the aspect 
of sampling variability taken into account. 



Reliability of additional indicator in public high schools 

In order to reliably determine whether or not a school/LEA has made progress in the high school 
graduation rate, the Wyoming Department of Education will examine the school’s graduation 
rate in comparison to a set standard of 80 percent graduation. However, the major concern of 
this methodology is the over-identification of small schools and alternative schools. Small 
schools can have graduation rates that are highly variable due to small class sizes. Alternative 
schools, due to the nature of the population they serve, have a low graduation rate but make 
drastic differences in the educational careers of those they serve. Therefore, a second step of the 
methodology will examine progress in the school’s graduation rate. 

The methodology for determining if a school or LEA has made progress on the additional 
indicator will proceed as follows: 

1. A high school’s graduation rate will be calculated in alignment with the formula 
described in Section 7.1. 

2. Schools with a graduation rate of 80 percent or higher will have satisfactorily met 
the additional indicator. Schools exhibiting a graduation rate below 80 percent 
will be further examined for progress. 

3. Schools with a graduation rate below 80 percent will have their graduation rate 
compared to the graduation rate from the previous year. High schools showing 
a positive increase in graduation rate from the previous year will have met the 
additional indicator. 

4. Small schools with less than thirty (30) exiters in either year’s graduation rate 
calculation (denominator) will be examined individually to ensure a valid 
decision. This is crucial due to the possibility of high variability with small 
group sizes seen in Wyoming. This examination will include an examination of 
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past trend data utilizing a trend line of three years data to ensure positive progress 
is being demonstrated in graduation rate over time as well as a determination of 
whether a small school missed the standard graduation rate standard by only one 
or two students. It is estimated that this further examination will impact fewer 
than ten schools. 



Validity 



Wyoming will not be able to truly evaluate the validity of the additional indicators for several 
years. However, it is believed that the use of the reduction in the percentage of students scoring 
in the lowest performance levels as the additional indicator will help improve the consequential 
validity of the accountability system for the lowest performing students. In addition, Wyoming 
believes the goal of reducing the number of below basic students in reading is well aligned with 
goals found in the state’s elementary and middle schools and will be accepted by schools and 
teachers as having merit. 

In utilizing graduation rate for public high schools, one would expect that this indicator is a valid 
measurement of the “success” of the school. In graduating students, schools are holding their 
students accountable for attainment of state content standards and endorsing that students have 
mastered the required content. Thus, graduation rate should be a valid indicator for school 
accountability. 
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PRINCIPLE 8. AYP is based on reading/language arts and mathematics 
achievement objectives. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


8.1 Does the state measure 
achievement in 
reading/language arts and 
mathematics separately for 
determining AYP? 


State AYP determination for 
student subgroups, public 
schools and LEAs separately 
measures reading/language arts 
and mathematics. 10 

AYP is a separate calculation for 
reading/language arts and 
mathematics for each group, 
public school, and LEA. 


State AYP determination for 
student subgroups, public 
schools and LEAs averages or 
combines achievement across 
reading/language arts and 
mathematics. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 8.1 

WyCAS includes separate tests in reading, writing, and mathematics. Wyoming’s approach for 
calculating a language arts composite score from the reading and writing scores is described 
under Element 3.2a. Wyoming’s separate starting points for language arts and mathematics 
indicate that Wyoming measures student achievement separately for language arts and 
mathematics. 



For a school or LEA to be considered to have made AYP, it must meet its performance targets in 
BOTH language arts and mathematics, as well as the other academic indicator. In order for a 
school to be classified as being in need of improvement, it must fail to make AYP for two 
consecutive years for the same content area, regardless of the subgroup. In order for a LEA to be 
classified as being in need of improvement, it must fail to make AYP for two consecutive years 
for the same content area or other academic indicator in all three grade spans (elementary, 
middle/junior high, and high school), regardless of the subgroup. 



10 If the state has more than one assessment to cover its language arts standards, the State must create 
a method for including scores from all the relevant assessments. 
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PRINCIPLE 9. State Accountability System is statistically valid and reliable. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.1 HowdoAYP 

determinations meet the 
State’s standard for 
acceptable reliability? 


State has defined a method for 
determining an acceptable level of 
reliability (decision consistency) 
for AYP decisions. 

State provides evidence that 
decision consistency is (1) within 
the range deemed acceptable to 
the State, and (2) meets 
professional standards and 
practice. 

State publicly reports the estimate 
of decision consistency, and 
incorporates it appropriately into 
accountability decisions. 

State updates analysis and 
reporting of decision consistency 
at appropriate intervals. 


State does not have an 
acceptable method for 
determining reliability (decision 
consistency) of accountability 
decisions, e.g., it reports only 
reliability coefficients for its 
assessments. 

State has parameters for 
acceptable reliability; however, 
the actual reliability (decision 
consistency) falls outside those 
parameters. 

State’s evidence regarding 
accountability reliability (decision 
consistency) is not updated. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 9.1 

There are two aspects of reliability that need to be discussed in relation to this element: one 
minor and one major. The minor issue, classical test reliability, is one that measurement 
specialists have focused on for many years when thinking about tests for making decisions about 
individual students. Test reliability describes how much measurement error is associated with 
each student’s (actually, it is usually the average student’s) observed test score. The test 
reliability for WyCAS is very high for all tests with alpha coefficient values all greater than 0.90. 
There is no “standard” for satisfactory levels of reliability, but it is generally accepted in the 
measurement community (e.g., Ysseldyke, 1990) that when making high stakes decisions about 
students, a reliability coefficient of 0.90 or greater should be required. In Wyoming’s case, the 
state is not making high-stakes decisions about individual students, but the state still meets this 
unofficial reliability standard. Nevertheless, test reliability is only a minor component of the 
error variance associated with determinations of school ratings. 

The major component of error variance associated with each school or LEAs yearly ranking is 
the sampling variability caused by testing different students each year. The accountability 
system is based on the inference that the test scores of any particular cohort of students tell us 
something about the quality or effectiveness of their school. Wyoming is not concerned, per se, 
with the collective scores of the cohort of students as an absolute, rather the scores of any 
particular cohort are viewed as an indicator of the school. Therefore, the students tested in any 
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one year should be considered a sample of all possible students who could have attended that 
school over the lifetime of the school. This means that sampling variability — the error 
associated with different students being tested in any one year — must be considered when 
evaluating the reliability of the accountability system. Many researchers have demonstrated that 
sampling variability overshadows any variance due to test reliability (e.g., Arce-Ferrer, Frisbie, 
Kolen, 2002; Cronbach, Brennan, Linn, and Haertel, 1997; Hill, 2001; Linn, Baker, and 
Betebenner, 2002). 

This is a major problem for Wyoming because sampling variability is inversely related to sample 
size — the number of students tested in any one year. For example, the standard (sampling) error 
with 25 students tested and 50 percent of them scoring proficient is equal to 10 percent, meaning 
that for an observed proportion of 50 percent, one could be 95 percent confident that the “true” 
proportion proficient would be between 30 percent and 70 percent. Clearly this is an 
unacceptable level of uncertainty especially since many of Wyoming’s schools test fewer than 25 
students in any given year. It is precisely for this reason that Wyoming has adopted an AYP 
model that relies on modeling this sampling variability and applying confidence intervals 
(statistical tests) for every decision made. As described above (Element 5.5), Wyoming 
computed confidence intervals for each of the nine decisions (comparisons of each subgroup to 
the performance target) required for each of the two content areas (mathematics and language 
arts). 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.2 What is the State's process 
for making valid AYP 
determinations? 


State has established a process 
for public schools and LEAs to 
appeal an accountability decision. 


State does not have a system for 
handling appeals of accountability 
decisions. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 9.2 

The question of whether Wyoming’s AYP determinations are valid can be examined in many 
different ways. Determining whether or not a process is valid depends on the overall goal of the 
accountability and assessment system. If the processes and decisions that come from the system 
align with this goal and aid in the progress towards the goal, it can be said they are valid. 

Wyoming’s accountability goal is to ensure equitable educational opportunities throughout the 
state. No matter where a student resides in Wyoming, they should receive equitable 
opportunities to learn. Students’ opportunities to learn should be exclusive of a student’s race, 
ethnicity, disability, limited English proficiency, socioeconomic status, or other classifications. 

It is with this goal in mind that the accountability system and processes were developed. 

The determination of whether or not the processes are valid must be based on evidence and, 
therefore, will be evaluated as the system is implemented. Validity of the AYP decisions for 
schools and LEAs can be examined once the system is implemented and there are available data. 
The Wyoming Department of Education will examine outcomes of the AYP decisions in order to 
insure the validity of the decisions. The questions that have to be asked to support the argument 
of validity of the accountability system need to be: 

- Are measurable changes taking place in schools due to the impact of the accountability 
system? 

- Is the desired impact on student achievement happening? 

- Is the accountability system sensitive to appropriate reform actions? 

- Are the appropriate schools being identified for action? 

- Are the rewards and sanctions adequate and just for the related performance? 

- Do the rewards and sanctions have the desired effect of influencing schools? 

In order to examine validity, the Wyoming Department of Education will have to examine 
outcomes of the system after it is implemented. AYP decisions can be validated by observing 
additional information and evidence in order to determine if the decision was correct. Wyoming 
will be participating in Council of Chief State School Officers (CCSSO) sponsored workshops 
that address the issues of examining validity in state accountability decisions. From these 
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learning opportunities, Wyoming should be better positioned in the near future to provide 
thoughtful validity investigations of the states accountability system. 



Validity of decisions also has to be examined from the perspective of the school and LEA. Is the 
AYP determination viewed as valid from the school/LEA perspective? The Wyoming 
Department of Education has provided workshops throughout the past year detailing the AYP 
process and gathering feedback regarding improvements. 

Specific pieces of the accountability system that can be referenced in regard to validity of AYP 
decisions are summarized below. These individual pieces help to insure the AYP decisions are 
as valid as possible. 

- Any school or LEA may appeal decisions made regarding AYP to the Wyoming 
Department of Education (WDE) within thirty (30) days of the AYP determination. 

- The state assessment system (WyCAS) has been judged as valid, and several research 
studies have been completed to support this. 

- Utilizing a group size of 30 (except for the interim rule for small schools) should lend 
support to a valid decision being made regarding the schools achievement. 

- The use of other indicators (percent reading below basic and graduation rate) align with 
the educational goals of the system. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.3 How has the State planned 
for incorporating into its 
definition of AYP 
anticipated changes in 
assessments? 


State has a plan to maintain 
continuity in AYP decisions 
necessary for validity through 
planned assessment changes, 
and other changes necessary to 
comply fully with NCLB. 11 

State has a plan for including new 
public schools in the State 
Accountability System. 

State has a plan for periodically 
reviewing its State Accountability 
System, so that unforeseen 
changes can be quickly 
addressed. 


State’s transition plan interrupts 
annual determination of AYP. 

State does not have a plan for 
handling changes: e.g., to its 
assessment system, or the 
addition of new public schools. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 9.3 

Wyoming has anticipated changes in assessments and has planned accordingly to ensure 
continuity of AYP decisions. Since the State currently assesses fourth, eighth, and eleventh 
grade, standards committees were convened in 2002 to construct specific content and 
achievement standards for the newly included grade levels. With these finalized in January 
2003, development of assessments will begin in summer of 2004 and refining of the assessments 
will continue into 2005. The new assessments will be piloted in the 2004-2005 school year and 
fully implemented in the 2005-2006 school year. In this piloting phase, results obtained from the 
new assessments will be scrutinized and will help ensure the continuity of valid AYP school 
decisions. Once this information is available, decisions will be made regarding possible 
recalculation of starting points and how assessment information over multiple grade spans will 
be aggregated to determine school AYP measures. With the new assessment system, it may be 
possible for the incorporation of student growth measures to determine school performance. 

Wyoming plans to include all new schools in the AYP accountability process the first year that 
assessment data is available for that school. Since the AYP indicators are calculated using one 
year of data, after the school’s first year of administering the state assessment the school will be 
held accountable for the achievement of its students. 



11 Several events may occur which necessitate such a plan. For example, (1) the State may need to 
include additional assessments in grades 3-8 by 2005-2006; (2) the State may revise content and/or 
academic achievement standards; (3) the State may need to recalculate the starting point with the 
addition of new assessments; or (4) the State may need to incorporate the graduation rate or other 
indicators into its State Accountability System. These events may require new calculations of validity and 
reliability. 
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The more likely scenario in Wyoming is schools closing and consolidating due to decreasing 
enrollment. When schools close, the affected grade levels are absorbed into other schools and 
these schools will then be held accountable for the achievement of those students (applying the 
state standard for full academic year determinations, as applicable). The school(s) will not be 
penalized or benefited by the AYP status of the closed school. This also holds for schools that 
lose grades due to new schools being opened or grade reconfigurations among schools within an 
LEA. 
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PRINCIPLE 10. In order for a public school or LEA to make AYP, the State 
ensures that it assessed at least 95% of the students enrolled in each subgroup. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 0.1 What is the State's method 
for calculating participation 
rates in the State 
assessments for use in 
AYP determinations? 


State has a procedure to 
determine the number of absent 
or untested students (by 
subgroup and aggregate). 

State has a procedure to 
determine the denominator (total 
enrollment) for the 95% 
calculation (by subgroup and 
aggregate). 

Public schools and LEAs are held 
accountable for reaching the 95% 
assessed goal. 


The state does not have a 
procedure for determining the 
rate of students participating in 
statewide assessments. 

Public schools and LEAs are not 
held accountable for testing at 
least 95% of their students. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 10.1 



Participation rates in the State assessments are calculated by dividing the number of students 
participating in the assessment by the total number of enrolled students in the school/LEA at the 
time of testing. Per recent USED guidance, where a school/LEA fails to meet the minimum 
annual participation rate of 95 percent based on current year data, Wyoming will average the 
participation rate data over the past three years to ensure a more reliable and valid decision of 
participation rate. Furthermore, students who have not participated in the state assessment due to 
expulsion or medical emergencies will not be used in the calculation of school or LEA 
participation rate. These circumstances of the non-participants are beyond the educational 
control of the school/LEA and thus should not unnecessarily degrade the related participation 
rate. In the 2004 assessment cycle, only 18 students in the entire state did not participate due to 
expulsion or medical emergencies. Any student for whom there is not an assessment result will 
be counted as “not participating” in the statewide assessment system. The participation rates are 
calculated separately for language arts and mathematics at an aggregate level and at the subgroup 
level for all schools and LEAs. In either content area, failure to assess 95 percent of the students 
enrolled, overall and in each subgroup, leads to the school or LEA being identified as not 
meeting AYP. 

According to Wyoming Statute 21-2-304 (a), every Wyoming public school student enrolled in 
fourth, eighth, and eleventh grades is required to participate in WyCAS and be assessed in 
reading, writing, and mathematics. This requirement is further supported by Wyoming State 
Board Rules, Chapter 6. All Neglected and Delinquent Institutions subject to accreditation 
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requirements of the Wyoming State Board of Education are also required to have their students 
participate in WyCAS. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


10.2 What is the State’s policy 
for determining when the 
95% assessed 
requirement should be 
applied? 


State has a policy that 
implements the regulation 
regarding the use of 95% 
allowance when the group is 
statistically significant according 
to State rules. 


State does not have a procedure 
for making this determination. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Element 10.2 

Wyoming will use a minimum group size of forty (40) prior to applying the 95 percent 
participation rate test for all groups (with no confidence interval used with regard to this 
determination). 
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Appendix A 

Required Data Elements for State Report Card 



1111(h)(1)(C) 

1 . Information, in the aggregate, on student achievement at each proficiency level on the State academic 
assessments (disaggregated by race, ethnicity, gender, disability status, migrant status, English 
proficiency, and status as economically disadvantaged, except that such disaggregation shall not be 
required in a case in which the number of students in a category is insufficient to yield statistically reliable 
information or the results would reveal personally identifiable information about an individual student. 

2. Information that provides a comparison between the actual achievement levels of each student 
subgroup and the State’s annual measurable objectives for each such group of students on each of the 
academic assessments. 

3. The percentage of students not tested (disaggregated by the student subgroups), except that such 
disaggregation shall not be required in a case in which the number of students in a category is insufficient 
to yield statistically reliable information or the results would reveal personally identifiable information 
about an individual student. 

4. The most recent 2-year trend in student achievement in each subject area, and for each grade level, 
for the required assessments. 

5. Aggregate information on any other indicators used by the State to determine the adequate yearly 
progress of students in achieving State academic achievement standards disaggregated by student 
subgroups. 

6. Graduation rates for secondary school students disaggregated by student subgroups. 

7. Information on the performance of local educational agencies in the State regarding making adequate 
yearly progress, including the number and names of each school identified for school improvement under 
section 1116. 

8. The professional qualifications of teachers in the State, the percentage of such teachers teaching with 
emergency or provisional credentials, and the percentage of classes in the State not taught by highly 
qualified teachers, in the aggregate and disaggregated by high-poverty compared to low-poverty schools 
which (for this purpose) means schools in the top quartile of poverty and the bottom quartile of poverty in 
the State. 
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